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Abstract 

We define the concept of an internal symmetry. This is a 
symmety within a solution of a constraint satisfaction prob- 
lem. We compare this to solution symmetry, which is a map- 
ping between different solutions of the same problem. We 
argue that we may be able to exploit both types of symmetry 
when finding solutions. We illustrate the potential of exploit- 
ing internal symmetries on two benchmark domains: Van der 
Waerden numbers and graceful graphs. By identifying inter- 
nal symmetries we are able to extend the state of the art in 
both cases. 



Introduction 

Symmetry is an important feature of many combinato- 
rial search problems. To be able to solve such prob- 
lems, we often need to take account of symmetry. For ex- 
ample, when finding magic squares (prob019 in CSPLib 
(IGent and Walsh 1999l l), we have the symmetries that rotate 
and reflect the square. Factoring such symmetry out of the 
search space is often critical when trying to solve large in- 
stances of a problem. Up till now, research on symmetry has 
mostly focused on symmetries between different solutions of 
the same problem. In this paper, we propose considering in 
addition the internal symmetries (that is, symmetries within 
each solution). Whilst it appears to be challenging to iden- 
tify useful internal symmetries, such symmetries are easy 
to exploit. We simply add constraints that restrict search 
to those solutions with the required internal symmetry and 
limit branching to the subset of decisions that generate a 
complete solution. We will demonstrate the value of exploit- 
ing internal symmetries within solutions with experimental 
results on two benchmark domains; Van der Waerden num- 
bers and graceful graphs. 

Symmetry between solutions 

A symmetry cr is a bijection on assignments. Given a set 
of assignments A and a symmetry cr, we write (j{A) for 
{(7(a) I a e A}. Similarly, given a set of symmetries S, 
we write T,{A) for {cr(a) \ a ^ A, a G S}. A special type 
of symmetry, called solution symmetry is a symmetry be- 
tween the solutions of a problem. Such a symmetry maps 



solutions onto solutions. A solution is simply a set of as- 
signments that satisfy every constraint in the problem. More 
formally, we say that a problem has the solution symmetry a 
iff (T of any solution is itself a solution iCohen et al. 20061) . 
As such mappings are associativity, and the inverse of a so- 
lution symmetry and the identity mapping are solution sym- 
metries, the set of solution symmetries E of a problem forms 
a group under composition. We say that two sets of assign- 
ments A and B are in the same symmetry class of S iff there 
exists (T G E such that a{A) = B. 

Running example. The magic squares problem is to label a 
nbyn square so that the sum of every row, column and diag- 
onal are equal (prob019 in CSPLib ([Gent and Walsh 1999\l ). 
A normal magic square contains the integers 1 to r? . We 
model this with n? variables Xi,j where Xij = k iff the ith 
column and jth row is labelled with the integer k. 

"Lo Shu", the smallest non-trivial normal magic square 
has been known for over four thousand years and is an im- 
portant object in ancient Chinese mathematics: 
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(1) 



The magic squares problem has a number of solution sym- 
metries. For example, consider the symmetry Ud that reflects 
a solution in the leading diagonal. This map "Lo Shu " onto 
a symmetric solution: 
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(2) 
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Any other rotation or reflection of the square maps one so- 
lution onto another The 8 symmetries of the square are thus 
all solution symmetries of this problem. In fact, there are 
only 8 different magic square of order 3, and all are in the 
same symmetry class. 

One way to factor solution symmetry out of 
the search space is to post symmetry break- 
ing constraints. See, for instance, (Puget 1993 
ICrawford et al. 19961 IFTener et al. 20021 IFrisch et al. 2002 
Walsh 2006al IWalsh 2006bl ILawetal. 2007 

|Walsh_2007). For example, we can eliminate ad by 
posting a constraint which ensures that the top left corner 
is smaller than its symmetry, the bottom right corner. This 
selects Q and eliminates Q. 



Symmetry within a solution 

Symmetries can also be found within individual solutions 
of a constraint satisfaction problem. We say that a solution 
A contains the internal symmetry a (or equivalently cr is a 
internal symmetry within this solution) iff (J (A) = A. 

Running example. Consider again "Lo Shu ". This con- 
tains an internal symmetry. To see this, consider the solution 
symmetry Omv that inverts labels, mapping konton^ + l — k. 
This solution symmetry maps "Lo Shu" onto a different (but 
symmetric) solution. However, if we now apply the solution 
symmetry aiso that rotates the square 180°, we map back 
onto the original solution: 
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Consider the composition of these two symmetries: ainv ° 
(JiSQ- As this symmetry maps "Lo Shu" onto itself, the solu- 
tion "Lo Shu" contains the internal symmetry ainv ° '^lao- 

One significant difference between a solution symmetry 
and an internal symmetry is that a solution symmetry is a 
property of every solution whilst an internal symmetry is a 
property of just the given solution. 

Running example. Consider the following magic square: 
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c^inv ° fiso not an internal symmetry contained within this 
solution: 
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However, ainv°cri80 is an internal symmetry found within 
the following solution: 
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Thus we can conclude that a^v ° crigo is an internal symme- 
try contained within some but not all solutions of the normal 
magic squares problem. In fact, 48 out of the 880 distinct 
normal magic squares of order 4 contain this internal sym- 
metry. On the other hand, <Tinv ° cigo is a solution symmetry 
of normal magic square problems of every size. 

A solution containing an internal symmetry can often be 
described by a subset of assignments and one or more sym- 
metries acting on this subset that generate a complete set of 
assignments. Given a set of symmetries E, we write S* for 
the closure of E. That is, = E, E* = {<ti o cr2 | fi G 
E,cr2 e E* = UjS'- Given a solution A, we 

say the subset B of A and the symmetries E generate A 
iff A = _B U E*(_B). In this case, we also describe A as 
containing the internal symmetries E. 



Running example. Consider again the solution which 
contains the internal symmetry ainv ° criso- Half this magic 
square and ainv ° ctiso generate the whole solution: 
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In fact, can be generated from just the first quadrant 
and two symmetries: ainv ° figo and a symmetry r which 
constructs a 180° rotation of the first quadrant in the sec- 
ond quadrant, decrementing those squares on the leading 
diagonal and incrementing those on the trailing diagonal 
(the same symmetry constructs the third quadrant from the 
fourth). More precisely, r makes the following mappings: 
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The example hints at how we can exploit internal sym- 
metries within solutions. We will limit search to a subset 
of the decision variables that generates a complete set of as- 
signments and construct the rest of the solution using the 
generating symmetries. 

Theoretical properties 

We identify some properties of internal symmetries that wiU 
be used to help find solutions. 

Set of internal symmetries within a solution 

Like solution symmetries, the internal symmetries within a 
solution form a group. A solution A contains a set of inter- 
nal symmetries E (or equivalently E are internal symmetries 
within the solution) iff A contains a for every cr G E. 

Proposition 1. The set of internal symmetries E within a 
solution A form a group under composition. 

Proof: The identity symmetry is trivially an internal sym- 
metry. Internal symmetries are also trivially closed under 
composition. Finally, consider any ct G E. As a (A) = A, 
a-\a{A)) = a-^{A). That is A ^ a-^{A). Hence, the 
inverse of a is an internal symmetry. □ 

Symmetries within and between solutions 

In general, there is no relationship between the solution sym- 
metries of a problem and the internal symmetries within a 
solution of that problem. There are solution symmetries of a 
problem which are not internal symmetries within any solu- 
tion of that problem, and vice versa. The problem Zi ^ Z2 
has the solution symmetry that swaps Zi with Z2, but no so- 
lutions of Zi 7^ Z2 contain this internal symmetry. On the 
other hand, the solution Zi = Z2 ^ of Zi < Z2 contains 
the internal symmetry that swaps Zi and Z2, but this is not 
a solution symmetry of Zi < Z2 (since Zi = 0, Z2 = 1 is 
a solution but its symmetry is not). When all solutions of a 
problem contain the same internal symmetry, we can be sure 
that this is a solution symmetry of the problem itself. 



Proposition 2. If all solutions of a problem contain an in- 
ternal symmetry then this is a solution symmetry. 

Proof: Consider any solution A. As all solutions of the 
problem contain the internal symmetry cr, ct( A) = A. Hence 
a maps A onto itself, and a{A) is also a solution. □ 

By modus tollens, it follows that if a is not a solution 
symmetry of a problem then there exists at least one solution 
which does not contain the internal symmetry a. 

Symmetries of symmetric solutions 

We next consider internal symmetries contained within sym- 
metric solutions. In general, the symmetry of a solution 
contains the conjugate of any internal symmetry contained 
within the original solution. 

Proposition 3. If the solution A contains the internal sym- 
metry a and r is any (other) symmetry then t{A) contains 
the internal symmetry t o a o t~^. 

Proof: Consider the action of r o ct o r^^ on t{A). Now 
r((7(r~^(r(A)))) = t(ct(A)). But as A contains the inter- 
nal symmetry a, a (A) = A. Hence T{a{A)) — t{A). Thus 
T o CT o maps t{A) onto itself. □ 

In the special case that symmetries commute, the symme- 
try of a solution contains the same internal symmetries as 
the original problem. Two symmetries a and r commute iff 
a o T = T o a. 

Proposition 4. If the solution A contains the internal sym- 
metry a and r commutes with a then t{A) also contains the 
internal symmetry a. 

Proof: By Proposition [3] t{A) contains the internal sym- 
metry T°a o T^^. But r o CT o = T o o a — a. 

□ 

Symmetry breaking 

Finally, we consider the compatibility of eliminating sym- 
metric solutions and focusing search on those solutions that 
contain particular internal symmetries. In general, the two 
techniques are incompatible. Symmetric breaking may elim- 
inate all those solutions which contain a given internal sym- 
metry. 

Running example. Consider again the solution This 
contains the internal symmetry o amv that inverts all val- 
ues and reflects the square in the vertical axis: 
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Note that this internal symmetry can only occur within 
magic squares of even order or of order 1. 

Suppose symmetry breaking eliminates all solutions in the 
same symmetry class as (O except for a symmetric solution 
which is a 90° clockwise rotation of^. This solution does 
not contain the internal symmetry o cTinv In fact, this 
rotation of contains the internal symmetry that inverts 
all values and reflects the square in the horizontal axis. 
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We can identify a special case where symmetry break- 
ing does not change any internal symmetry within solu- 
tions. Suppose symmetry breaking only eliminates symme- 
tries which commute with the internal symmetry contained 
within a particular solution. In this case, whilst symmetry 
breaking may eliminate the given solution, it must leave a 
symmetric solution containing the given internal symmetry. 
Given a set of constraints C with solution symmetries S, we 
say that a set of symmetry breaking constraints S is sound 
iff for every solution of C there exists at least one solution 
of C U 5 in the same symmetry class. 

Proposition 5. Given a set of constraints C with solution 
symmetries S, a sound set of symmetry breaking constraints 
S, and a solution A containing the internal symmetry a, if 
a commutes with every symmetry in E then there exists a 
solution of C yj S in the same symmetry class as A also 
containing the internal symmetry a. 

Proof: As S is sound, there exists a solution S of C U 5 and 
T G S with B = t{A). Now t commutes with a. Therefore 
by Proposition]?] B contains the internal symmetry a. □ 

Running example. Consider the internal symmetry amv ° 
(7180 contained within some (but not all) normal magic 
squares. This particular symmetry commutes with every 
rotation, reflection and inversion solution symmetry of the 
problem. Hence, if there is a solution with the internal sym- 
metry ffinv ° CTiso, this remains true after breaking the rota- 
tional, reflection and inversion symmetries. However, as in 
the last example, there are internal symmetries contained 
within some solutions (like reflection in the vertical axis) 
which do not commute with all symmetries of the square. 

Exploiting symmetries within solutions 

The exploitation of internal symmetries involves two steps: 
finding internal symmetries, and then restricting search to 
solutions containing just these internal symmetries. The 
first step appears challenging. The definition of an internal 
symmetry is rather weak. There will be many uninteresting 
internal symmetries contained within a solution. We want 
to find internal symmetries that are likely to be contained 
within as yet unsolved instances of our problem. Although 
we do not yet have an efficient set of automated methods to 
do this, we can focus on simple symmetries (like the solu- 
tion symmetries of the problem) and on small and already 
solved instances of a problem. This may suggest internal 
symmetries which might be contained in solutions of larger 
(perhaps open) problems. 

Once we have identified an internal symmetry which we 
conjecture may be contained in solutions of other (perhaps 
larger) instances of the problem, it is a simple matter to re- 
strict search of a constraint solver to solutions of this form. 
In general, if we want to find solutions containing the inter- 
nal symmetry a, we post symmetry constraints of the form: 



In addition, we can limit branching decisions to a subset 
of the decisions variables that generates a complete set of 
assignments. This can significantly reduce the size of the 
search space. Propagation of the problem and symmetry 
constraints may prune the search space even further 

Running example. Consider again the problem of finding 
normal magic squares. We coded this problem in BProlog 
on a Pentium 4 3.2 GHz processor with 3GB of memory. 
In addition to the problem constraints, we used symmetry 
breaking constraints that eliminated most of the rotation, re- 
flection and inversion solution symmetries: 



n.n 

XiA < + 1 - max(Xi4,Xi,„,X„,i,X„,„) 



(5) 



We also used symmetry constraints to ensure a simple 
internal symmetry was within the solution. Even and odd 
order magic squares often contain different internal sym- 
metries so we used different symmetry constraints for even 
and odd n. For even n, we looked for solutions containing 
CTt, o cTinv Recall that this internal symmetry cannot be con- 
tained in solutions with odd n ( except n = 1). For odd n, we 
looked instead for solutions containing Umv ° fiso- Hence, 
we used the following symmetry constraints for 1 < i,j < 
n: 



odd{n) X, 



n+l— j,n+l — i 



evenln) 



X 



n-\-l — i.,j 



+ 1-X,, 
1 — Xii 



(6) 



In the fallowing table, we report backtracks (b) and time 
( t) in seconds to find an order n normal magic square us- 
ing the default branching heuristic, the problem constraints 
(P), the symmetry breaking constraints and the internal 
symmetry constraints 



n 


P: b/t 


P +|5J b/t 


P +|6J b/t 


P +I5JI6I b/t 
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2/0.00 


1/0.00 


1/0.00 


1/0.00 
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18/0.00 


72/0.00 


13/0.00 


12/0.00 
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6656/0.13 


5693/0.12 


2287/0.03 


38/0.00 
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4.47 • 10^/ 


1.92 • 10^/ 


959018/ 


959018/ 




2.43 • 10^ 


6618.38 


28.08 


28.63 



We see that both symmetry breaking and internal symme- 
try constraints speed up search. In addition, the combina- 
tion of the two is usually better than either on their own. 

Van der Waerden numbers 

We illustrate the use of internal symmetries within solutions 
with two applications where we have been able to extend the 
state of the art. In the first, we found new lower bound cer- 
tificates for Van der Waerden numbers. Such numbers are an 
important concept in Ramsey theory. In the second applica- 
tion, we increased the size of graceful labellings known for 
a family of graphs. Graceful labelling has practical applica- 
tions in areas like communication theory. 

The Van der Waerden number, W{k, I) is the smallest in- 
teger n such that if the integers 1 to rt are colored with k 
colors then there are always at least / integers in arithmetic 
progression. For instance, W{2, 3) is 9 since the two sets 



{1, 4, 5, 8} and {2, 3, 6, 7} contain no arithmetic progression 
of length 3, but every partitioning of the integers 1 to 9 into 
two sets contains an arithmetic progression of length 3 or 
more. The certificate that W{2, 3) > 8 can be represented 
with the following blocks: 



1 2 3 4 5 6 7 8 

Finding such certificates can be encoded as a constraint 
satisfaction problem. To test if W{k, I) > n, we introduce 
the Boolean variable Xi j where i S [0, fc), j G [0, n) and 
constraints that each integer takes one color (Vig[o fc) ^ij)' 
and that no row of colors contains an arithmetic progression 
of length I (xi^a A ... A Xi^a+d{i-2) -> ^x,^a+d{i-i))- This 
problem has a number of solution symmetries. For exam- 
ple, we can reverse any certificate and get another symmetric 
certificate. We can also permute the colors and get another 
symmetric certificate: 



Individual certificates also often contain internal symme- 
try. For example, the second half of the last certificate re- 
peats the first half: 

Hence, this certificate contains the internal symmetry that 
maps a; J J onto mod s- 

In fact, many known certificates can be generated from 
some simple symmetry operations on just the colors as- 
signed to the first two or three integers. For instance, 
the first construction method for Van der Waerden certifi- 



cates (Rabung 1979 1 made use of the observation that the 
largest possible certificates for the known numbers iy(fc, ? J3 
consist of a repetition of / — 1 times a base pattern. All these 
certificates, as well as all best lower bounds, have a base 
pattern of size m = j^. This first method only worked for 
certificates for which m is prime. An improved construction 
method ( [Herwig et al. 2007 ) generalises it for non-prime to. 

An important concept in both construction methods is the 
primitive roo0 of to denoted by r. Let p be the largest prime 
factor of TO, then r is the smallest number for which: 

(mod to) 7^ r-' (mod m) for 1 < i < j < q 
We identified four internal symmetries: 



(7) 



<J+in 
CJxr 



Apply to all elements Xij 
Apply to all elements Xij 
Apply to all elements Xij 



+ m (mod n) 
+ p (mod m) 
X r (mod m) 



At least one subset maps onto itself after applying 
Xi,j := Xij- X r* (mod m) for a i G {1, . . . , fc} 



Consider the largest known certificate for W{b, 3) which 
has 170 elements. For this certificate, to ~ 85, p = 17, and 
r 3. Below the base pattern is shown the first 85 elements. 
Notice that for this certificate A, <j4^p{A) and a^ri.-^) are 
also certificates. In fact, after sorting the elements and per- 
muting the subsets, this certificate is mapped onto itself after 
applying these symmetries. 

'Except for W(3, 3) 

^Our use slightly differs from the conventional definition 
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Given these symmetries, we can easily construct a com- 
plete certificate. We place the first and last elements (1 and 
85) in the first subset and apply axr to generate all ele- 
ments in this subset. We apply a^p to partition the elements 
{1, . . . , 85}. Finally, we obtain a complete certificate by ap- 
plying cr+„i. We generalised this into a construction method. 
To find a larger certificate W{k,l,n), we test with a con- 
straint solver for increasing n = (mod ^ — 1) whether a 
certificate can be obtained using the following steps: 

• break solution symmetry by forcing that the first subset of 
the partition maps onto itself after applying tTxr* 

• choose te{l,...,k},qe{l,...,j} 

• place elements q and m in the first subset 

• apply the symmetries ctxt*. fxr, o'+p, and ct+„i, to con- 
struct a certificate A with n' elements 

• check with a constraint solver if A lacks an arithmetic 
progression of length I 

Using this method we significantly improved some of the 
best known lower boundfl 

• W{3, 7) > 48811. The old bound was 43855. 

• VK(4, 7) > 420217. The old bound was 393469. 

Graceful graphs 

Our second application of internal symmetries is graceful la- 
belling. A graph with e edges is called graceful if its vertices 
can be labelled with the distinct values {0, . . . , e} in such a 
way that each edge gets a unique label when it is assigned 
the absolute difference of the vertices it connects. Graceful 
labelling has a wide range of applications in areas like radio 
astronomy, cryptography, communication networks and cir- 
cuit design. Whilst various classes of graphs are known to 
be graceful JGallian 199? i). there are others where it is not 
known but is conjectured that they are graceful. One such 



class is the class of double wheel graphs. The graph DWn 
consists of two cycles of size n and a hub connected all the 
vertices. The largest double wheel graph that we have seen 
graceful labelled in the literatur^ has size 10. 




The problem of finding a graceful labelling can be 
specified using 2n + 1 variables Xi with domain 
{0, . . . , e}. This problem has I6n^ solution symme- 
tries (IPetrie and Smith 20031 : 

• Rotation of the vertices (n^ symmetries) 

• Inversion of the order of the vertices (4 symmetries) 

• Swapping of the inner and outer wheel (2 symmetries) 

• Inversion of the labels, Xi :— An ~ Xi (2 symmetries) 

To identify internal symmetries, we generated all graceful 
labellings for DW4. This is the smallest double wheel graph 
with a graceful labelling. We observed two internal symme- 
tries within the 44 solutions of DW4: 

<T4n' In 31 solutions, the hub had label 4n or {(Jinv)- 

cr+2: If I < X, < n - 2, then X,+2 := X, + 2 
Although we observed 17+2, we restrict this internal symme- 
try to 1 < < n — 4 because it proved more effective. 

When both symmetries are applied, the computational 
costs to find a graceful labelling is significantly reduced. 
Consider DW2a- To construct a graceful labelling, we first 
assign the hub to value 96 (applying fT4„). Second, we label 
the first vertex of the outer wheel with 1 and label the first 
vertex of the inner wheel with 2. Third, we apply symme- 
try (T_|_2 to label n-1 vertices with the labels {l,...,ri — 1}. 
Finally, we use a constraint solver to label the remaining ver- 
tices. Using this method we found the first known graceful 
labeling for DW24 (see overleaf). 

The following table gives the runtime (in seconds) for our 
constraint solver to find graceful labellings of DWn for the 
original problem (P) with and without symmetry breaking 
(SB) constraints (IPetrie and Smith 20031 1. The last column 
shows the results when we force internal symmetries within 
solutions. This also breaks the solution symmetries. 



n 


P 


P + SB 


P + 0'4n, cr+2 


4 


0.04 


0.03 


0.03 


8 


0.24 


0.23 


0.21 


12 


20.42 


18.34 


0.91 


16 


554.30 


259.75 


11.31 


20 


> 7200 


2634.67 


117.08 


24 


> 7200 


> 7200 


602.09 



^See |www . st . ewi . tudelf t ■ nl/sat / ~waerden . php| 



See www . comp . leeds . ac . uk/bms/Gracef ul/ 




Related work 

Several forms of symmetry have been identified and 
exploited in search. For instance. Brown, Finkel- 
stein and Purdom defined symmetry as a permutation 
of the variables leaving the set of solutions invariant 
( |Brown, Finkelstein, and Purdom. 1988| l. This is a subset 
of the solution symmetries. For the propositional calcu- 
lus, Krishnamurthy was one of the first to exploit sym- 
metry (Kjishnamurthy 1985 1. He defined symmetry as a 



permutation of the variables leaving the set of clauses un- 
changed. Benhamou and Sais extended this to a per- 
mutation of the literals preserving the set of clauses 
(IBenhamou and Sais 1992 i Perhaps closest to this work is 
Puget's symmetry breaking method that considers symme- 
tries which stabilize the current partial set of assignments 



( Puget 2003^ . By comparison, we consider only those sym- 
metries which stabilize a complete set of assignments. 

Conclusions 

We have defined the concept of an internal symmetry within 
a single solution of a constraint satisfaction problem. We 
compared this with the existing notion of symmetry between 
different solutions of the same problem. We demonstrated 
that we can exploit both types of symmetry when solving 
constraint satisfaction problems. We illustrated the potential 
of exploiting internal symmetry on two benchmark domains: 
Van der Waerden numbers and graceful graphs. By identi- 
fying internal symmetries, we were able to extend the state 
of the art in both cases. With Van der Waerden numbers, we 
improved two lower bounds by around 10%. With graceful 
graphs, we more than doubled the size of the largest known 
double wheel graph with a graceful labelling. 
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